User placement of closed captioning

ABSTRACT

Placement of Closed Captioning (CC) in content by a content provider is overridden by means of a user interface (UI) that allows the user to place CC on screen on top of the video. The CC may be derived directly from the audio and synchronized with play of the audio and video.

FIELD

The present application relates to technically inventive, non-routinesolutions that are necessarily rooted in computer technology and thatproduce concrete technical improvements.

BACKGROUND

One of the biggest complaints with Closed Captioning is that (CC)because it is overlaid on the video it interferes with the display ofthe video. It can obscure faces, gestures, and action shown in the videoas well as scrolling banners that may be delivered as part of the video.

One of the ways to mitigate the problem, if allowed by the displaydevice, is to minimize the size of the CC text so that it does notobscure as much video. This may make it difficult to read depending onhow close the view is to the TV. And even then, the CC can be misplacedand it will obscure some critical aspect of the video. Furthermore,particularly for live events in which the broadcaster's closedcaptioning is typically typed in by a stenographer as people speak andthus noticeably lags the speech itself and accompanying video, the lossof synchronization is between the CC and speech is distracting and canbe disorienting to hearing-impaired people who may be attempting to bothlip read the speakers and read the CC.

SUMMARY

Present principles recognize the above problems and so provide a systemwith a first decoder for decoding audio received at an audio videodevice (AVD) at a first time, and a speech-to-text (STT) converterreceiving output from the first decoder to render closed captioning(CC). A second decoder decodes the same audio but at a second time laterthan the first time to generate decoded audio. At least one speakerplays the decoded audio while at least one display presents the CC insynchronization with playing the decoded audio on the at least onespeaker.

The first decoder may be implemented by a network server system and thesecond decoder may be implemented by the AVD. The STT converter can beimplemented by the network server system. In other embodiments, thefirst decoder is implemented by the AVD.

In example implementations, the display is configured to present videoassociated with the audio in a window that is less than all of a videodisplay area of the display. In non-limiting examples, the windowincludes only first and second corners of the video display area, withthe CC being presented in a CC region outside of the window.

In some non-limiting examples, the display may be configured to presentat least one user interface (UI) enabling selection to present the CCrendered by the STT converter and selection to present CC received froma content source in lieu of or in addition to CC rendered by the STTconverter.

In another aspect, a device includes at least one computer storage thatis not a transitory signal and that in turn includes instructionsexecutable by at least one processor to decode first audio received at adisplay device at a first point in time using a first decoderimplemented by the display device or by a network server receiving thefirst audio from the display device. The instructions are executable togenerate text from the first audio received from the first decoder, andto decode the first audio at a second point of time later than the firstpoint in time using a second decoder. Furthermore, the instructions areexecutable to present the text on a display in synchronization withplaying the first audio decoded by the second decoder on at least onespeaker of the display device.

In another aspect, a server system includes at least one serverprocessor and at least one server computer storage with instructionsexecutable by the at least one server processor for receiving audio viaa network from an end user display device. The instructions also areexecutable for decoding the audio to render decoded audio, and forsending the decoded audio or a text representation thereof back to theend user display device via the network.

The details of the present disclosure, both as to its structure andoperation, can be best understood in reference to the accompanyingdrawings, in which like reference numerals refer to like parts, and inwhich:

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of an example system including an example inconsistent with present principles;

FIG. 2 is a screen shot of an example user interface (UI) allowing auser to select where in a display closed caption (CC) is to bepresented;

FIG. 3 is a screen shot of decimated video on a display with closedcaptioning appearing according to selections made using, e.g., the UI ofFIG. 2;

FIG. 4 is a schematic diagram showing dual decoding of buffered audio togenerate CC and decoded audio; and

FIG. 5 is a flow chart of example logic illustrating synchronization oflocally-generated CC with audio and video presentation.

DETAILED DESCRIPTION

This disclosure relates generally to computer ecosystems includingaspects of consumer electronics (CE) device based user information incomputer ecosystems. A system herein may include server and clientcomponents, connected over a network such that data may be exchangedbetween the client and server components. The client components mayinclude one or more computing devices including portable televisions(e.g. smart TVs, Internet-enabled TVs), portable computers such aslaptops and tablet computers, and other mobile devices including smartphones and additional examples discussed below. These client devices mayoperate with a variety of operating environments. For example, some ofthe client computers may employ, as examples, operating systems fromMicrosoft, or a Unix operating system, or operating systems produced byApple Computer or Google. These operating environments may be used toexecute one or more browsing programs, such as a browser made byMicrosoft or Google or Mozilla or other browser program that can accessweb applications hosted by the Internet servers discussed below.

Servers may include one or more processors executing instructions thatconfigure the servers to receive and transmit data over a network suchas the Internet. Or, a client and server can be connected over a localintranet or a virtual private network. A server or controller may beinstantiated by a game console such as a Sony Playstation®, a personalcomputer, etc.

Information may be exchanged over a network between the clients andservers. To this end and for security, servers and/or clients caninclude firewalls, load balancers, temporary storages, and proxies, andother network infrastructure for reliability and security. One or moreservers may form an apparatus that implement methods of providing asecure community such as an online social website to network members.

As used herein, instructions refer to computer-implemented steps forprocessing information in the system. Instructions can be implemented insoftware, firmware or hardware and include any type of programmed stepundertaken by components of the system.

A processor may be any conventional general-purpose single- ormulti-chip processor that can execute logic by means of various linessuch as address lines, data lines, and control lines and registers andshift registers.

Software modules described by way of the flow charts and user interfacesherein can include various sub-routines, procedures, etc. Withoutlimiting the disclosure, logic stated to be executed by a particularmodule can be redistributed to other software modules and/or combinedtogether in a single module and/or made available in a shareablelibrary.

Present principles described herein can be implemented as hardware,software, firmware, or combinations thereof; hence, illustrativecomponents, blocks, modules, circuits, and steps are set forth in termsof their functionality.

Further to what has been alluded to above, logical blocks, modules, andcircuits described below can be implemented or performed with ageneral-purpose processor, a digital signal processor (DSP), a fieldprogrammable gate array (FPGA) or other programmable logic device suchas an application specific integrated circuit (ASIC), discrete gate ortransistor logic, discrete hardware components, or any combinationthereof designed to perform the functions described herein. A processorcan be implemented by a controller or state machine or a combination ofcomputing devices.

The functions and methods described below, when implemented in software,can be written in an appropriate language such as but not limited to C#or C++, and can be stored on or transmitted through a computer-readablestorage medium such as a random access memory (RAM), read-only memory(ROM), electrically erasable programmable read-only memory (EEPROM),compact disk read-only memory (CD-ROM) or other optical disk storagesuch as digital versatile disc (DVD), magnetic disk storage or othermagnetic storage devices including removable thumb drives, etc. Aconnection may establish a computer-readable medium. Such connectionscan include, as examples, hard-wired cables including fiber optics andcoaxial wires and digital subscriber line (DSL) and twisted pair wires.

Components included in one embodiment can be used in other embodimentsin any appropriate combination. For example, any of the variouscomponents described herein and/or depicted in the Figures may becombined, interchanged or excluded from other embodiments.

“A system having at least one of A, B, and C” (likewise “a system havingat least one of A, B, or C” and “a system having at least one of A, B,C”) includes systems that have A alone, B alone, C alone, A and Btogether, A and C together, B and C together, and/or A, B, and Ctogether, etc.

Now specifically referring to FIG. 1, an example ecosystem 10 is shown,which may include one or more of the example devices mentioned above anddescribed further below in accordance with present principles. The firstof the example devices included in the system 10 is an example primarydisplay device, and in the embodiment shown is an audio video displaydevice (AVDD) 12 such as but not limited to an Internet-enabled TV.Thus, the AVDD 12 alternatively may be an appliance or household item,e.g. computerized Internet enabled refrigerator, washer, or dryer. TheAVDD 12 alternatively may also be a computerized Internet enabled(“smart”) telephone, a tablet computer, a notebook computer, a wearablecomputerized device such as e.g. computerized Internet-enabled watch, acomputerized Internet-enabled bracelet, other computerizedInternet-enabled devices, a computerized Internet-enabled music player,computerized Internet-enabled head phones, a computerizedInternet-enabled implantable device such as an implantable skin device,etc. Regardless, it is to be understood that the AVDD 12 is configuredto undertake present principles (e.g. communicate with other CE devicesto undertake present principles, execute the logic described herein, andperform any other functions and/or operations described herein).

Accordingly, to undertake such principles the AVDD 12 can be establishedby some or all of the components shown in FIG. 1. For example, the AVDD12 can include one or more displays 14 that may be implemented by a highdefinition or ultra-high definition “4K” or “8K” (or higher resolution)flat screen and that may be touch-enabled for receiving consumer inputsignals via touches on the display. The AVDD 12 may include one or morespeakers 16 for outputting audio in accordance with present principles,and at least one additional input device 18 such as e.g. an audioreceiver/microphone for e.g. entering audible commands to the AVDD 12 tocontrol the AVDD 12. The example AVDD 12 may also include one or morenetwork interfaces 20 for communication over at least one network 22such as the Internet, an WAN, an LAN, etc. under control of one or moreprocessors 24. Thus, the interface 20 may be, without limitation, aWi-Fi transceiver, which is an example of a wireless computer networkinterface. It is to be understood that the processor 24 controls theAVDD 12 to undertake present principles, including the other elements ofthe AVDD 12 described herein such as e.g. controlling the display 14 topresent images thereon and receiving input therefrom. Furthermore, notethe network interface 20 may be, e.g., a wired or wireless modem orrouter, or other appropriate interface such as, e.g., a wirelesstelephony transceiver, or Wi-Fi transceiver as mentioned above, etc.

In addition to the foregoing, the AVDD 12 may also include one or moreinput ports 26 such as, e.g., a USB port to physically connect (e.g.using a wired connection) to another CE device and/or a headphone portto connect headphones to the AVDD 12 for presentation of audio from theAVDD 12 to a consumer through the headphones. The AVDD 12 may furtherinclude one or more computer memories 28 that are not transitorysignals, such as disk-based or solid-state storage (including but notlimited to flash memory). Also in some embodiments, the AVDD 12 caninclude a position or location receiver such as but not limited to acellphone receiver, GPS receiver and/or altimeter 30 that is configuredto e.g. receive geographic position information from at least onesatellite or cellphone tower and provide the information to theprocessor 24 and/or determine an altitude at which the AVDD 12 isdisposed in conjunction with the processor 24. However, it is to beunderstood that that another suitable position receiver other than acellphone receiver, GPS receiver and/or altimeter may be used inaccordance with present principles to e.g. determine the location of theAVDD 12 in e.g. all three dimensions.

Continuing the description of the AVDD 12, in some embodiments the AVDD12 may include one or more cameras 32 that may be, e.g., a thermalimaging camera, a digital camera such as a webcam, and/or a cameraintegrated into the AVDD 12 and controllable by the processor 24 togather pictures/images and/or video in accordance with presentprinciples. Also included on the AVDD 12 may be a Bluetooth transceiver34 and other Near Field Communication (NFC) element 36 for communicationwith other devices using Bluetooth and/or NFC technology, respectively.An example NFC element can be a radio frequency identification (RFID)element.

Further still, the AVDD 12 may include one or more auxiliary sensors 37(e.g., a motion sensor such as an accelerometer, gyroscope, cyclometer,or a magnetic sensor, an infrared (IR) sensor, an optical sensor, aspeed and/or cadence sensor, a gesture sensor (e.g. for sensing gesturecommand, etc.) providing input to the processor 24. The AVDD 12 mayinclude still other sensors such as e.g. one or more climate sensors 38(e.g. barometers, humidity sensors, wind sensors, light sensors,temperature sensors, etc.) and/or one or more biometric sensors 40providing input to the processor 24. In addition to the foregoing, it isnoted that the AVDD 12 may also include an infrared (IR) transmitterand/or IR receiver and/or IR transceiver 42 such as an IR dataassociation (IRDA) device. A battery (not shown) may be provided forpowering the AVDD 12.

Still referring to FIG. 1, in addition to the AVDD 12, the system 10 mayinclude one or more other CE device types. In one example, a first CEdevice 44 may be used to control the display via commands sent throughthe below-described server while a second CE device 46 may includesimilar components as the first CE device 44 and hence will not bediscussed in detail. In the example shown, only two CE devices 44, 46are shown, it being understood that fewer or greater devices may beused.

In the example shown, to illustrate present principles all three devices12, 44, 46 are assumed to be members of an entertainment network in,e.g., in a home, or at least to be present in proximity to each other ina location such as a house. However, for illustrating present principlesthe first CE device 44 is assumed to be in the same room as the AVDD 12,bounded by walls illustrated by dashed lines 48.

The example non-limiting first CE device 44 may be established by anyone of the above-mentioned devices, for example, a portable wirelesslaptop computer or notebook computer, and accordingly may have one ormore of the components described below. The second CE device 46 withoutlimitation may be established by a wireless telephone. The second CEdevice 46 may implement a portable hand-held remote control (RC).

The first CE device 44 may include one or more displays 50 that may betouch-enabled for receiving consumer input signals via touches on thedisplay. The first CE device 44 may include one or more speakers 52 foroutputting audio in accordance with present principles, and at least oneadditional input device 54 such as e.g. an audio receiver/microphone fore.g. entering audible commands to the first CE device 44 to control thedevice 44. The example first CE device 44 may also include one or morenetwork interfaces 56 for communication over the network 22 undercontrol of one or more CE device processors 58. Thus, the interface 56may be, without limitation, a Wi-Fi transceiver, which is an example ofa wireless computer network interface. It is to be understood that theprocessor 58 may control the first CE device 44 to undertake presentprinciples, including the other elements of the first CE device 44described herein such as e.g. controlling the display 50 to presentimages thereon and receiving input therefrom. Furthermore, note thenetwork interface 56 may be, e.g., a wired or wireless modem or router,or other appropriate interface such as, e.g., a wireless telephonytransceiver, or Wi-Fi transceiver as mentioned above, etc.

In addition to the foregoing, the first CE device 44 may also includeone or more input ports 60 such as, e.g., a USB port to physicallyconnect (e.g. using a wired connection) to another CE device and/or aheadphone port to connect headphones to the first CE device 44 forpresentation of audio from the first CE device 44 to a consumer throughthe headphones. The first CE device 44 may further include one or morecomputer memories 62 such as disk-based or solid-state storage. Also insome embodiments, the first CE device 44 can include a position orlocation receiver such as but not limited to a cellphone and/or GPSreceiver and/or altimeter 64 that is configured to e.g. receivegeographic position information from at least one satellite and/or celltower, using triangulation, and provide the information to the CE deviceprocessor 58 and/or determine an altitude at which the first CE device44 is disposed in conjunction with the CE device processor 58. However,it is to be understood that that another suitable position receiverother than a cellphone and/or GPS receiver and/or altimeter may be usedin accordance with present principles to e.g. determine the location ofthe first CE device 44 in e.g. all three dimensions.

Continuing the description of the first CE device 44, in someembodiments the first CE device 44 may include one or more cameras 66that may be, e.g., a thermal imaging camera, a digital camera such as awebcam, and/or a camera integrated into the first CE device 44 andcontrollable by the CE device processor 58 to gather pictures/imagesand/or video in accordance with present principles. Also included on thefirst CE device 44 may be a Bluetooth transceiver 68 and other NearField Communication (NFC) element 70 for communication with otherdevices using Bluetooth and/or NFC technology, respectively. An exampleNFC element can be a radio frequency identification (RFID) element.

Further still, the first CE device 44 may include one or more auxiliarysensors 72 (e.g., a motion sensor such as an accelerometer, gyroscope,cyclometer, or a magnetic sensor, an infrared (IR) sensor, an opticalsensor, a speed and/or cadence sensor, a gesture sensor (e.g. forsensing gesture command, etc.) providing input to the CE deviceprocessor 58. The first CE device 44 may include still other sensorssuch as e.g. one or more climate sensors 74 (e.g. barometers, humiditysensors, wind sensors, light sensors, temperature sensors, etc.) and/orone or more biometric sensors 76 providing input to the CE deviceprocessor 58. In addition to the foregoing, it is noted that in someembodiments the first CE device 44 may also include an infrared (IR)transmitter and/or IR receiver and/or IR transceiver 78 such as an IRdata association (IRDA) device. A battery (not shown) may be providedfor powering the first CE device 44.

The second CE device 46 may include some or all of the components shownfor the CE device 44.

Now in reference to the afore-mentioned at least one server 80, itincludes at least one server processor 82, at least one computer memory84 such as disk-based or solid-state storage, and at least one networkinterface 86 that, under control of the server processor 82, allows forcommunication with the other devices of FIG. 1 over the network 22, andindeed may facilitate communication between servers and client devicesin accordance with present principles. Note that the network interface86 may be, e.g., a wired or wireless modem or router, Wi-Fi transceiver,or other appropriate interface such as, e.g., a wireless telephonytransceiver.

Accordingly, in some embodiments the server 80 may be an Internetserver, and may include and perform “cloud” functions such that thedevices of the system 10 may access a “cloud” environment via the server80 in example embodiments. Or, the server 80 may be implemented by agame console or other computer in the same room as the other devicesshown in FIG. 1 or nearby.

FIG. 2 shows a user interface (UI) 200 that may be presented on thedisplay 14 of the AVD (equivalently, it may be presented audibly on,e.g., the speakers 16) to enable a person to select a location at whichclosed captioning (CC) is to appear. The CC may be that received fromthe content provider and/or that generated dynamically as describedfurther below.

As shown, the UI 200 includes a side selector 202 with left and rightsub-selectors selectable to cause CC to be presented on, respectively,left and/or right borders of the display region. The UI 200 alsoincludes top and bottom selectors 204 selectable to cause CC to bepresented on, respectively, top and/or bottom borders of the displayregion. A broadcast selector 206 may be included and may be selectableto cause the CC that is to be presented to be that received from acontent provider such as a broadcaster, while a dynamic CC selector 208may be provided and may be selectable to cause the CC that is to bepresented to be that which is generated dynamically from the programaudio and synchronized therewith as described further below.

FIG. 3 illustrates the results of one or more selections from FIG. 2.The video, reduced as by decimation, is presented in a window 300 thelower right corner of which has been moved up and left from the lowerright corner 302 of the display region as indicated by the arrow 304. Itis to be understood that the decimated video window may alternatively bemoved down and left from the upper right control of the display region,down and right from upper left corner of the display region, or up andright from the lower left corner of the display region.

In this way, a bottom border region 306 is provided for presenting CCin. Also, a right-side region 308 is made available for presenting CCin.

FIG. 4 is a schematic diagram of a system for generating CC dynamicallyfrom input audio. A data buffer 400 that may be maintained by the AVD 12and/or shared with a cloud server buffers incoming video 402 and relatedincoming audio 404. For disclosure purposes assume data flows right toleft in the buffer 400 on a first in-first out basis.

A first audio decoder decodes audio 404 at a first point of time in thebuffer, e.g., as soon as the audio enters the buffer. The decoded audiois converted to text by a speech-to-text converter 408 and output as CC410. The first audio decoder may be implemented by an AC3 decoder andthe STT converter may be implemented by a processor executing STTsoftware, such as the processor of the AVD or a separate STT processoron, e.g., a field programmable gate array (FPGA).

As the audio is decoded and converted, the timing information (such asdigital timestamps) accompanying the audio are preserved, so that the CC410 has the same timing information as the corresponding audio fromwhich it has been derived. The first decoder 406 may be implemented bythe AVD or by a cloud server to which the AVD sends the audio. In thelatter case, the need for the AVD to include two decoders, such as twoAC3 decoders with attendant two license fees, is eliminated. When thefirst decoder is implemented by a network server, the CC 410 is sentback to the AVD from the server.

A second audio decoder 412 decodes the same audio as the first audiodecoder 406 but further along in the buffer 400 as the audio progressesthrough the buffer. The second decoder 412 may be implemented by theAVD. The latency between the buffer locations at which the decoders 406,412 decode the audio is preferably sufficient to allow the first decoderand STT converter 408 time to receive the audio and generate the CC 410prior to presenting decoded audio from the second decoder 412 on thespeakers 16 of the AVD 12.

Although no video decoders are shown in FIG. 4 for simplicity ofdisclosure, it is to be understood that the video 402 also is decoded.The decoded video is then presented on the display 14 synchronized bymeans of the timing information accompanying the video 402 and itsassociated audio 404 with the audio played on the speakers 16. It willreadily be appreciated that the dynamically generated CC 410 is alsopresented on the display 14, synchronized with the audio being played onthe speakers, such that a hearing-impaired person, for example, can readthe CC simultaneously as a character in the video is speaking the audio,and not sometime after as typically occurs with broadcast CC of liveevents, for instance.

FIG. 5 illustrates the above in example non-limiting logic flow format.At block 500, at a time=t₀, audio is decoded with the first decoder andthe timing information retained. STT is executed at block 502, e.g., bythe STT converter 408, with the timing information being transferred tothe text, which is output at block 504 as the CC 410.

Sometime later, at a time=t₀+Δt, the same audio is decoded at block 506by the second decoder 412. Block 508 indicates that the audio decoded bythe second decoder is played on the speakers 16 in synchronization withthe CC generated by the first decoder and STT converter, using thetiming information. The processor of the AVD can coordinate thissynchronization by playing audio and presenting CC simultaneously on thedisplay that has timing information matching the audio being played atthe same time.

In some embodiments, present principles annotate the closed captioningper speaker to ease attempts for the hearing impaired to read closedcaptioning. During the speech to text conversion, the process may note achange in speaker in the audio. In an example, the process can note thatthe voice fingerprint of the speech being converted to text has changed.This may be done by periodically executing a voice fingerprint onreceived speech in audio and entering a data structure of templatefingerprints to determine what specific individual is speaking (by, forinstance, finding a match to the voice fingerprint that correlates to aspecific individual) or what generic speaker is speaking (by, forinstance, finding a match to the voice fingerprint that correlates to atype of individual, such as man, woman, child, etc.) The closedcaptioning can annotate the specific or generic individual whose speechis being reproduced by text, e.g., when a man speaks “Hi, I want to saysomething”, the reproduced text may read: “Man: Hi, I want to saysomething”, and if a female speaker in the audio responds “What did youwant to say?”, the reproduced text may read: “Woman: What did you wantto say?”. Or, the speakers can be designated as “speaker 1”, “speaker2”, . . . .

While particular techniques are herein shown and described in detail, itis to be understood that the subject matter which is encompassed by thepresent application is limited only by the claims.

What is claimed is:
 1. A system comprising: a first decoder for decodingaudio received at an audio video device (AVD) at a first time; aspeech-to-text (STT) converter receiving output from the first decoderto render closed captioning (CC); a second decoder for decoding theaudio at a second time later than the first time to generate decodedaudio; at least one speaker for playing the decoded audio; and at leastone display for presenting the CC in synchronization with playing thedecoded audio on the at least one speaker.
 2. The system of claim 1,wherein the first decoder is implemented by a network server system andthe second decoder is implemented by the AVD.
 3. The system of claim 2,wherein the STT converter is implemented by the network server system.4. The system of claim 1, wherein the first decoder is implemented bythe AVD.
 5. The system of claim 1, wherein the display is configured topresent video associated with the audio in a window comprising less thanall of a video display area of the display, the window comprising onlyfirst and second corners of the video display area, the CC beingpresented in a CC region outside of the window.
 6. The system of claim1, wherein the display is configured to present at least one userinterface (UI) enabling selection to present the CC rendered by the STTconverter and selection to present CC received from a content source inlieu of or in addition to CC rendered by the STT converter.
 7. A devicecomprising: at least one computer storage that is not a transitorysignal and that comprises instructions executable by at least oneprocessor to: decode first audio received at a display device at a firstpoint in time using a first decoder implemented by the display device orby a network server receiving the first audio from the display device;generate text from the first audio received from the first decoder;decode the first audio at a second point of time later than the firstpoint in time using a second decoder; and present the text on a displayin synchronization with playing the first audio decoded by the seconddecoder on at least one speaker of the display device.
 8. The device ofclaim 7, wherein the first decoder is implemented by the display device.9. The device of claim 7, wherein the first decoder is implemented bythe network server.
 10. The device of claim 7, wherein the seconddecoder is implemented by the display device.
 11. The device of claim 7,wherein the text is converted from the first audio by the networkserver.
 12. The device of claim 7, wherein the text is converted fromthe first audio by the display device.
 13. The device of claim 7,wherein the instructions are executable to present video associated withthe audio in a window comprising less than all of a video display areaof the display device, the window comprising only first and secondcorners of the video display area, the text being presented in a regionoutside of the window.
 14. The device of claim 7, wherein theinstructions are executable to present at least one user interface (UI)enabling selection to present the text and selection to present closedcaptioning (CC) received from a content source in lieu of or in additionto the text.
 15. A server system, comprising: at least one serverprocessor; and at least one server computer storage with instructionsexecutable by the at least one server processor for: receiving audio viaa network from an end user display device; decoding the audio to renderdecoded audio; and sending the decoded audio or a text representationthereof back to the end user display device via the network.
 16. Theserver system of claim 15, wherein the instructions are executable forgenerating text from the decoded audio.
 17. The server system of claim15, wherein the instructions are executable for sending the decodedaudio back to the end user display device via the network.
 18. Theserver system of claim 15, wherein the instructions are executable forsending a text representation of the decoded audio back to the end userdisplay device via the network.
 19. The server system of claim 15,wherein the audio is AC3 audio.